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Description 

METHOD AND SYSTEM FOR DETECTING 
FIRE IN A PREDETERMINED AREA 

Background of Invention 
[0001] 1. Field of the Invention 

[0002] The present invention relates to a method and system for 
detecting early fires in a predetermined area, and more 
particularly, to a method and system that can detect if im- 
ages contain flames and if a flame increases to be a fire. 

[0003] 2. Description of the Prior Art 

[0004] Generally, a HSI (hue/saturation/intensity) domain is usu- 
ally utilized for analyzing images, since hue, saturation 
and intensity can represent all combinations of light to 
describe color. One prior art method detects if images 
have flames in the HSI domain. The method includes cap- 
turing images in a predetermined area, transforming RGB 
of each pixel of the images into HSI, and determining if 
the HSI of each pixel complies with rules in the HSI do- 



mam. 



[0005] In the prior art, the RGB of each pixel is transformed into 
the HSI by the following equations: 
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[0006] In the prior art, HSI is utilized for analyzing flame. The HSI 
domain is divided into six regions, as shown in Fig. 1. Fig. 
1 is a table of hue, RGB model and color range. The color 
range of a common fire is from red to yellow; therefore, 
the hue of fire is from 0 to 60 degrees. Saturation of a fire 
changes with background illumination. For instance, the 



color of a fire during tlie day or under an extra liglit 
source lias a stronger saturation tlian tliat of during tlie 
night or liaving no liglit source. That is, the color of a fire 
during the day or with the extra light source displays less 
white while the color of fire during the night or having no 
light source displays more white. A fire found in images 
captured during the night is more white in hue because 
the fire is the typically the only luminous entity in the im- 
ages. Additionally, for providing sufficient brightness in 
video processing, the intensity should be over a threshold. 
Experimental results according to the prior art show that 
each HSI pixel of a fire should satisfy the following condi- 
tions: 

(li) Brighter environment: 30 < ^ < 100 ^ 

Darker environment: 20 < ^ < 100 ■ 
(ill) 127 S -r S 25J 

[0007] The method mentioned above for detecting fire includes a 
series of complicated equations to transform RGB into HSI, 
which requires intensive computations. Besides, the low 
bound of the saturation condition (ii) may be too small to 
work correctly and hence it will yield a false fire-detection 



due to the appearance of reflected flames. 
[0008] Furthermore, in a fire detecting system, another important 
function is to generate a fire alarm to prevent a fire acci- 
dent. The method for generating a fire alarm according to 
the prior art compares the number of fire pixels to a 
threshold. If the number of fire pixels in an image is 
larger than the threshold, a fire alarm is output. However, 
the method is confined by the distance between the fire 
and an image capturing device (such as a camera). This 
enormously increases the false fire alarm rate and thus 
cannot adequately achieve the purpose of detecting early 
fires. 

[0009] For example, suppose that the size of a flame is constant, 
such as a flame of a candle or a lighter. This kind of flame 
does not constitute a fire accident; therefore, a fire alarm 
is not required. Please refer to Fig. 2 to Fig. 5. Fig. 2 and 
Fig. 4 are diagrams of the same flame 20 of a lighter and 
an image capturing device 12 separated by different dis- 
tances. Fig. 2 shows that the flame 20 is far away from the 
image capturing device 12 and Fig. 4 shows that the flame 
20 is near the image capturing device 12. The image cap- 
turing device 12 only captures images in a predetermined 
area. If the distance of the flame 20 and the image cap- 



turing device 12 is longer, as dl shows in Fig. 2, tlie size 
of the flame 20 in a frame is much smaller; that is, the 
number of fire pixels is small, as shown in Fig. 3. On the 
contrary, if the distance of the flame 20 and the image 
capturing device 12 is shorter, as d2 shows in Fig. 4, the 
size of the flame 20 in a frame is much larger; that is, the 
number of fire pixels is large as shown in Fig. 4. As shown 
in Fig. 3 and Fig. 5, the flame 20 in Fig. 3 approximately 
occupies 1.4 squares and the flame 20 in Fig. 5 approxi- 
mately occupies 14 squares. Suppose that the threshold is 
7 squares, the fire alarm is not provided due to the result 
of Fig. 3 while the fire alarm is provided due to the result 
of Fig. 5. The same flame 20 of the lighter results in dif- 
ferent effects due to the distance of the flame 20 to the 
image capturing device 12. The result of Fig. 3 does not 
lead to a false fire alarm, but the result of Fig. 5 does. 
[0010] In another situation, supposing that the flame spreads out 
and forms a fire, a fire alarm should be generated. Please 
refer to Fig. 6 to Fig. 17. Fig. 6, 8, and 10 show a flame 30 
spreading out to be flames 40 and 50, the distance from 
the image capturing device 12 being dl. Fig. 7, 9, and 11 
show numbers of fire pixels of Fig. 6, 8, and 10, respec- 
tively. Fig. 12, 14, and 16 show a flame 30 spreading out 



to be flames 40 and 50, the distance from the image cap- 
turing device 12 being the shorter 62. Fig. 13, 15, and 17 
show numbers of fire pixels of Fig. 12, 14, and 16, re- 
spectively. The image capturing device 12 only captures 
images in a predetermined area. If the distance between 
the flames 30, 40, and 50 and the image capturing device 
12 is dl, the sizes of the flame 30, 40, and 50 in a frame 
are much smaller; that is, the numbers of fire pixels are 
small, as shown in Fig. 7, 9, and 11. On the contrary, if 
the distance between the flames 30, 40, and 50 and the 
image capturing device 12 is d2, the sizes of the flame 
30, 40, and 50 in a frame are much larger; that is, the 
numbers of fire pixels are large, as shown in Fig. 13, 15, 
and 17. Suppose that the fire alarm is given if the number 
of fire pixels reaches 15. Although the flame 30 has 
spread to be the flame 50 thereby causing a fire accident, 
the fire alarm is not generated due to the result of Fig. 11 
so occupants are not alerted to escape from the fire acci- 
dent. Because the distance between the image capturing 
device 12 and the scene of the fire is longer, the image 
capturing device 12 has no ability to detect that the fire 
exists. Although the fire alarm is correctly provided due to 
the result of Fig. 17, this is only because the distance be- 



tween the image capturing device 12 and tlie flame 50 is 

just riglit. In the prior art, the position of the fire cannot 

be detected in a real environment. The image capturing 

device 12 cannot accurately detect if a fire is formed. 

Therefore, the fire alarm cannot be efficiently provided to 

prevent a fire accident. 
Summary of Invention 

[0011] It is therefore a primary objective of the claimed invention 
to provide a method for detecting early fires in a prede- 
termined area to solve the above-mentioned problem. 

[0012] The claimed invention includes capturing a plurality of 

images in a predetermined area for generating a plurality 
of difference frames during an interval, detecting a num- 
ber of pixels that have fire characteristics in each differ- 
ence frame, and if the detection result indicates that the 
flame of the predetermined area substantially increases 
during the interval, outputting an early fire alarm. 

[0013] These and other objectives of the present invention will no 
doubt become obvious to those of ordinary skill in the art 
after reading the following detailed description of the pre- 
ferred embodiment that is illustrated in the various fig- 
ures and drawings. 
Brief Description of Drawings 



[0014] pjg 1 is a table of hue, RGB model, and color range. 

[0015] Fig. 2 to Fig. 17 show the detection of early fires and the 

numbers of fire pixels according to the prior art. 
[0016] Fig. 18 is a graph of red component R versus saturation S. 

[0017] Fig. 19 is a diagram of a video detecting system. 

[0018] Fig. 20 is a flowchart of detecting early fires according to 

the present invention. 

[0019] Fig. 21 to Fig. 44 show the detection of early fires and the 

numbers of fire pixels according to the present invention. 
Detailed Description 

[0020] In order to shed light on the present invention, the first 
discussion relates how to detect fire pixels of frames, and 
the second discussion relates how to detect a flame in- 
creasing to become a fire. Finally, the best embodiment of 
detecting early fires, which combines the first method 
with the second method, is disclosed. 

[0021] Jo provide less-computational fire-detecting rules and 

overcome the problem of small low-bound in condition (ii) 
described previously, we develop a more cost-effective 
and reliable fire-detection strategy. Two basic ideas be- 
hind the proposed technique are based on direct process- 
ing with RGB model and solving the problem of the re- 



fleeted flames. As mentioned above, the color range of a 
common fire is from red to yellow. From the table in Fig. 
1, the relation of R, G, and B is R>G>B. If the RGB value of 
a pixel complies with the rule, the pixel may be a fire 
pixel. Then, other detections are required to be performed 
for the pixel. 

[0022] Because fire is a light source, the image capturing device 
needs sufficient brightness to capture useful image se- 
quences. From the color of fire, R is the maximum of R, G, 
and B and is thus the major component. There should be a 
stronger R in a fire image. Hence, the value of the R com- 
ponent should be over a threshold, Rt, which is obtained 
from the results of experiments. However, background il- 
lumination can affect the saturation of flames or generate 
a false appearance of flame so that false fire detection oc- 
curs. To prevent such a mistake caused by the back- 
ground illumination, the saturation of flames must satisfy 
a determined equation to eliminate the false appearance 
of flame. The determined equation is also obtained from 
the result of experiments. Based on the explanation 
above, the rules are described as follows: 



rule 1: R>Rt 
rule 2: R^G>B 

rule 3: IF (S ^C(255-R)*St /Rt)) 
fire pixel 
ELSE 

not fire pixel 



S is simplified by rule 2, 

3B 

S = l- 

[0023] In rule 3, when the value of the red component of a pixel 
is Rt, the saturation of the pixel is St. St and Rt are ob- 
tained from a great number of experiment values. Both St 
and Rt are affected by the background illumination, such 
as that during the day or the night. Therefore, St and Rt 
change with the environment. In rule 3, when R increases 
up to the value 255, the result should be zero. That is, S 
of fire pixels increases with R increasing while the result 
of rule 3 decreases. 

[0024] Please refer to Fig. 18. Fig. 18 is a graph of R versus S, 



obtained from many experiments. Tlie baclcground illumi- 
nation during the day is brighter; thus, R is smaller and S 
is larger. Conversely, the background illumination during 
the night is darker; thus, R is larger and S is smaller. The 
range of Rt is from 100 to 150 and the range of corre- 
sponding S is from 70 to 50, both obtained from experi- 
ments. These two ranges are suitable for detecting flames 
in both conditions, the day and the night. 

[0025] Detecting flames by the three rules only requires calculat- 
ing S according to RGB instead of transforming RGB into 
HSI. Also, the present invention reduces a lot of calcula- 
tion by directly utilizing RGB for detecting if pixels cap- 
tured are fire pixels. 

[0026] In addition, the color range of flames is from red to yellow 
and R is the maximum of components R, G, and B of a fire 
pixel, as shown in Fig. 1. Therefore, the basis of a flame is 
the R component. Thus, the present invention utilizes R as 
the basis for detecting flames. For instance, R must be 
over a threshold, Rt, and satisfy the relation R> G>B. Fi- 
nally, in order to reduce the effect of the background illu- 
mination, S must be over a result of an equation, rule 3. In 
the prior art, intensity I is an average of R, G, and B, as 
shown in equation (1), and G and B are considered in in- 



tensity I. Therefore, the prior art cannot accurately detect 
fire characteristics. Hence, the three rules of the present 
invention are more accurate than the prior art. 

[0027] jhe next discussion relates how to detect if a flame is in- 
creasing to be a fire. After detecting flames by the three 
rules, the number of fire pixels of each image can be cal- 
culated. Repeats of capturing images and recording the 
number of fire pixels of each image are required for the 
detection. Capturing K images and determining if the 
number of fire pixels increases over P%*K times indicates 
whether a flame is spreading out to become a fire, and if a 
fire alarm should be generated. 

[0028] For instance, suppose that K is 100 and P is 70. After cap- 
turing 100 images and calculating the numbers of fire 
pixels of each image, the number of fire pixels is com- 
pared between sequential images. If the number of fire 
pixels in a latter image is larger than that in a former im- 
age, the number of fire pixels has increased. In other 
words, the number of fire pixels of the i-th image is com- 
pared to that of the i+l-th image, and the number of fire 
pixels of the i+l-th image is compared to that of the 
i+2-th image, and so on. If the number of fire pixels in- 
creases over 70 (K*P%= 100*70%= 70) times, the flame is 



detected as spreading out to become a fire and a fire 
alarm should be generated. 

[0029] The methods mentioned above are carried out in a fire 

detection system. Please refer to Fig. 19. Fig. 19 is a dia- 
gram of the video detecting system 10 of the present in- 
vention. The image capturing device 12 is utilized for 
capturing images. A logic unit 14 controls the image cap- 
turing device 12 to capture a plurality of images 16 in a 
predetermined area during an interval for generating a 
plurality of difference frames, detects a number of fire 
pixels in each difference frame, and outputs a fire alarm if 
the detection result indicates that the flame of the prede- 
termined area substantially increases during the interval. 

[0030] Fig. 20 is a flowchart of detecting early fires according to 
the present invention. The steps are as follows: 

[0031] Step 100: start the fire detection system. 

[0032] Step 102: the image capturing device 12 captures a plu- 
rality of images and a background image. 

[0033] Step 104: detect if there is a difference between the back- 
ground image and the current image; that is, perform a 
difference frame process. The differences between the 
images captured by the image capturing device 12 and 
the background image are retained and noise of the dif- 



ferences is removed for generating a plurality of differ- 
ence frames. The difference between the current image 
and the background image is detected by the difference 
frame process. 

[0034] Step 106: detect if each pixel is a fire pixel by the three 
rules and record the numbers in each difference frame. If 
at least one of pixels is a fire pixel, go to step 108. Other- 
wise, if no pixel has fire characteristics, re-detect the dif- 
ference between the background image and the images 
captured by the image capturing device 12 and go to step 
104. 

[0035] Step 108: detect if the flame increases to be a fire accord- 
ing to the numbers of fire pixels of difference frames. If 
yes, go to step 110. If no, stay in step 108. Because pixels 
of difference frames are detected to be fire pixels, the 
flame is still small at this time. Therefore, continuously 
detect if the flame increases to be a fire. 

[0036] Step 100: if the number of fire pixels increases over K*P% 
times, it indicates that the flame spreads out to be a fire 
and a fire alarm should be generated. 

[0037] The present invention can reduce the calculations re- 
quired and efficiently reduce the false fire alarm rate while 
preventing fire accidents. 



[0038] As mentioned above, the prior art is confined by the dis- 
tance of the flame and the image capturing device so that 
the false fire alarm rate increases. The present invention 
can efficiently reduce the false fire alarm rate. 

[0039] For instance, suppose that the size of flame is constant, 
such as a flame of a candle or a lighter. This kind of flame 
will not bring about a fire accident; therefore, a fire alarm 
is not provided. Please refer to Fig. 21 to Fig. 32. Fig. 21, 
23, and 25 show the same flame 120, 130, and 140 mov- 
ing due to wind, the distance between the image captur- 
ing device 12 and the flame being dl. Fig. 22, 24, and 26 
show the numbers of fire pixels of Fig. 21, 23, and 25, re- 
spectively. Fig. 27, 29, and 31 show the same flame 120, 
130, and 140 moving due to wind, with the separation 
being d2. Fig. 28, 30, and 32 show the numbers of fire 
pixels of Fig. 27, 29, and 31, respectively. The image cap- 
turing device 12 captures images in the predetermined 
area. If the distance is dl, the sizes of the flames 120, 
130, and 140 in the frames are small. Due to the flames 
120, 130, and 140 being the same, the numbers of fire 
pixels of the flames 120, 130, and 140 are also approxi- 
mately the same. The number of fire pixels does not sig- 
nificantly increase when continuously capturing images. 



Even though the wind causes the flame to move, the num- 
ber just changes within a narrow range. In this case, when 
the present invention detects if the flame increases, the 
answer is no and a fire alarm is not generated. Similarly, if 
the distance is d2, the sizes of the flames 120, 130, and 
140 in the frames are larger. However, due to the flames 
120, 130, and 140 being the same, the numbers of fire 
pixels of the flames 120, 130, and 140 are also the sub- 
stantially the same. The number of fire pixels does not 
significantly increase when continuously capturing im- 
ages. Even though the wind causes the flame to move, the 
number just changes within a narrow range. Also, when 
the present invention detects if the flame increases, the 
result is negative and a fire alarm is not generated. 
[0040] In another situation, supposing that the flame spreads out 
and forms a fire, the fire alarm should be generated. 
Please refer to Fig. 33 to Fig. 44. Fig. 33, 35, and 37 show 
a flame 150 spreading out to becomes flames 160 and 
170, the distance from the image capturing device 12 be- 
ing the longer dl. Fig. 34, 36, and 38 show numbers of 
fire pixels of Fig. 33, 35, and 37, respectively. Fig. 39, 41, 
and 43 show the same flame 150 spreading out to be- 
come flames 160 and 170, the distance from the image 



capturing device 12 being the shorter d2. Fig. 40, 42, and 
44 show numbers of fire pixels of Fig. 39, 41, and 43, re- 
spectively. The image capturing device 12 only captures 
images in a predetermined area. Although the distance is 
dl, the flame spreads out. When the image capturing de- 
vice 12 captures images continuously, the number of fire 
pixels increases gradually. In this condition, when the 
present invention detects if the flame increases, the result 
is positive and a fire alarm is generated. Similarly, even 
though the flames 150, 160, and 170 are near the image 
capturing device 12, because the flame is spreading out, 
the number of fire pixels increases gradually. In this situ- 
ation a fire alarm is also provided. 

[0041] From the examples mentioned above, the present inven- 
tion efficiently reduces the false fire alarm rate. 

[0042] Generally, fires are formed by inflammable substances in 
a combustion-supporting atmosphere at suitable temper- 
ature. Equally important, it takes a period of time to form 
a fire. The present invention uses the period before a fire 
is fully formed to repeatedly record the number of fire 
pixels of difference frames for detecting if a flame in- 
creases, outputting a fire alarm when significant flame in- 
crease is determined. Thus, the flame can be extinguished 



before forming a full-scale fire. The present invention also 
can efficiently reduce the false fire alarm rate to achieve 
efficient fire detection. 
[0043] Those skilled in the art will readily observe that numerous 
modifications and alterations of the device may be made 
while retaining the teachings of the invention. Accord- 
ingly, the above disclosure should be construed as limited 
only by the metes and bounds of the appended claims. 



